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Abstract 

The K-uscr single-input single-output (SISO) AWGN interference channel and 2 x K SISO AWGN X channel 
in i.i.d. fading environment are considered where the transmitters have the delayed channel state information (CSI) 
through noiseless feedback links. It is known that both channels have no more than one degree of freedom (DoF) 
without CSI at transmitters. Transmission schemes based on a new multiphase interference alignment approach are 
proposed for these channels that achieve DoF values greater than one with delayed CSI at transmitters (delayed 
CSIT), except for the two-user interference channel. Moreover, the achieved DoFs are strictly increasing in K, 
and as K — > oo, approach limiting values of 61n 2_i ~ 1-2663 and ~ 1.4427 for interference and X channels, 
respectively. The achieved DoFs are greater than the best previously reported DoFs for these channels with delayed 
CSI at transmitters. 

I. Introduction 

The impact of feedback on the performance of a communication system has been extensively investigated 
from different perspectives. Although a negative result was first established by Shannon [|2) indicating 
that feedback does not increase the capacity of a memoryless point-to-point channel, there are various 
results affirming the significant effect of feedback on other performance criteria such as complexity and 
error probability of this channel. 

In multi-terminal networks, however, it has been shown that feedback can enlarge the capacity region 
of a multi-user channel. The capacity region enlargements for multiple access and broadcast channels 
with access to noiseless output feedback are reported for AWGN cases in [|3j, Q and for discrete cases 
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in [[5), [[6j. The capacity region enlargements in the AWGN multiple access and broadcast channels are 
"additive" which are bounded with increase of SNR. Suh et al. in [7| characterized the capacity region 
of a two-user AWGN interference channel (to within two bits) under the assumption that each transmitter 
has access to a noiseless feedback link from its respective receiver. They have shown that such feedback 
links can provide "multiplicative" gain in the capacity region of AWGN interference channels, i.e., the gap 
between the feedback and non-feedback capacity regions can be arbitrarily enlarged as SNR increases. 

An important performance measure for a power constrained communication channel is its degrees of 
freedom (DoF) which determines the behavior of the sum-capacity in high SNR regime. While it is 
always assumed that the receiver(s) know the channel coefficients perfectly and instantaneously, the CSI 
knowledge of transmitter(s) (CSIT) is usually subject to some limitations. At one extreme, it is assumed 
that the transmitter(s) know the CSI instantaneously and perfectly (full CSIT assumption). Under this 
condition, the capacity region (and hence, the DoF region) of the multiple-input multiple-output (MIMO) 
broadcast channel was characterized in [[8j. The DoF of the Abuser SISO interference channel was shown 
to be f with full CSIT [9]. It was shown in |fToh that the S x K SISO X channel can achieve sT^T 
DoF with full CSIT. At the other extreme, the transmitter(s) have no knowledge about CSI (no CSIT 



assumption). In this case, the A'-user MISO broadcast channel was studied in [11|. Other works include 



12|, [ 13 1 which investigate the DoF region of two-user MIMO broadcast and interference channels without 



CSIT. Later in [14|, the DoF regions of Abuser MIMO broadcast, interference and X channels with no 
CSIT were characterized. In specific, by developing some upper and lower bounds, they showed that the 
MISO broadcast, SISO interference and SISO X channel can achieve no more than one DoF. 

The access of transmitter(s) to the full instantaneous CSI is essentially an ideal assumption. While 
this assumption can be realized when the channel is subject to slow fading, it is not practically viable 
when channel variations are fast. In this situation, it is curious whether any type of feedback can improve 



the DoF performance of the channel. Recently, Maddah-Ali and Tse in [15|, [16| considered the MISO 
broadcast channel in fast fading environment where the transmitter obtains the past CSI through noiseless 
feedback (delayed CSIT assumption). Surprisingly, they showed that even in a fast fading setup, the 
delayed version of CSIT significantly improves the channel DoF. In particular, it was shown that the Ab- 
user MISO broadcast channel with M > K antennas at transmitter has 1 i_f ± DoF under delayed CSIT 



assumption. Subsequently, Abdoli et al. in [ 17 1 investigated the DoF of the three-user MIMO broadcast 
channel under delayed CSIT assumption and the DoF region of the two-user MIMO broadcast channel 
with delayed CSIT was obtained in p"8| [. The main idea in broadcast channels lies behind the following 
observations: Since the transmitter has access to both past CSI and past transmitted data symbols, it 
perfectly knows the whole past interference at each receiver. Also, an interference term at a receiver can be 
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a useful piece of information for some other receivers about their data symbols. Therefore, retransmission 
of such interference terms not only aligns the interference at some receivers, but also provides other 
receivers with a desired piece of information about their data symbols. 

In contrast to the broadcast channel, in networks with distributed transmitters such as interference and 
X channels, there is a fundamental constraint in using the knowledge of past CSI at transmitters: Each 
transmitter has only access to its own data symbols. Indeed, a transmitter cannot obtain the whole past 
interference at a receiver when the interference is due to more than one interferer. This restriction turns 
out to be a performance limiting factor in terms of DoF of the system for networks with more than two 



users. The DoF of the two-user MEMO interference channel with delayed CSIT is addressed in [19|, [20 1. 
In [21 1, Maleki et al. showed that the 2x2 SISO X and 3-user SISO interference channel can achieve | 
and | DoF, respectively, under delayed CSIT assumption. Soon thereafter, Ghasemi et al. in [22 [ achieved 
greater DoF of | for the 2 x 2 X channel and | for the 3 x 3 X channel. They also proposed an immediate 
generalization of their transmission scheme to the K x K case, K > 2, and achieved | — 3 (3K-i) 
with delayed CSIT. 

In this paper, we first investigate the 3-user SISO interference channel with delayed CSIT and show that 



II DoF is achievable in this channel. This is greater than the previously reported | DoF in [21 1. Then, we 
consider the K-user SISO interference channel for K > 3 with delayed CSIT, and propose a transmission 
scheme that achieves DoF values which are strictly increasing in K and approach the limiting value of 
t , ~ 1.2663 as K — > oo. Thereafter, we consider the 2x3 SISO X channel and show that this 

6 In 2—1 

channel can achieve | DoF under delayed CSIT assumption. By generalizing our transmission scheme to 
the 2 x K SISO X channel with delayed CSIT, we achieve DoF values which are strictly increasing in 
K and approach the limiting value of ^ ~ 1-4427 as K — > oo. For K > 3, our achievable DoFs for the 



2 x K X channel are strictly greater that the achievable DoFs reported in [22| for the K x K X channel 
with delayed CSIT. 

The schemes proposed in this paper for the i^-user interference and 2 x K X channels operate in K 
main phases: In phase 1, the transmitters send fresh data symbols together with some redundancy over 
time. The redundancy is such that "part" of the interference can be removed at each receiver by the end 
of this phase. Then, each transmitter exploits its knowledge of past CSI and its own transmitted data 
symbols to obtain the interference terms it caused at the non-intended receivers (if not already removed). 
Each of these interference terms, if being retransmitted, can align the past interference at a receiver while 
providing a useful linear combination for another receiver. Hence, they can be considered as common 
messages of order 2 and are fed to the system in phase 2 together with some redundancy over time. The 
transmitted redundancy again helps some receivers remove part of the interference. The transmitters again 
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using the past CSI and their own transmitted order-2 messages, will obtain their non-removed interference 
terms at non-intended receivers. This yields generation of common messages for subsets of cardinality 
3 of receivers. These order-3 messages, in turn, will be transmitted in phase 3, towards generation of 
order-4 messages. This procedure goes on phase by phase up to phase K where order-if messages will 
be delivered to all receivers without generating higher order messages. 



The rest of the paper is organized as follows: the system model is described in Section |H Section III 



presents the main results of the paper. In Sections IV and M our transmission schemes for SISO 



interference and X channels with delayed CSIT are introduced, respectively, and their achievable DoFs 



are obtained. Finally, Section VI concludes the paper. 



II. System Model 

For any integer K > 2, the discrete-time K-user SISO AWGN interference channel (IC) with private 
messages is defined by a set of K transmitter-receiver pairs (TXj, RXj), 1 < i < K, where TXj wishes 
to transmit message E to RXj. Moreover, the input-output relationship of this channel in time 
slot t, t — 1, 2, • • • , is specified by 

K 

Vj(t) = '$2h ji (t)x i (t) + z j (t), 1 <3< K ' (!) 
i=i 

where Xi(t) E C is the complex channel input symbol transmitted by TXj, yj(t) E C and Zj(t) ~ C/V(0, 1) 
are the complex received symbol and additive complex Gaussian noise at the input of RXj, respectively, 
and hjiit) E C is the complex channel coefficient from TXj to RXj. The channel input is subject to the 
average power constraint 

-VE[Mt)| 2 ]<P, (2) 

r z — ' 

t=i 

where r is the block length. The channel coefficients are assumed to be i.i.d. across the transmitters and 
receivers, and the noise is assumed to be i.i.d. across receivers as well as time. 

We further assume that the channel is subject to fast fading, that is, the channel coefficients are i.i.d. 
across time. Define the K x K channel matrix H(t) = [hji(t)] l<:i ^ <K . We make the following assumptions 
on the knowledge of transmitters and receivers about the CSI: 

• At the beginning of time slot t, t > 2, all transmitters and receivers perfectly know {H(t / )}|,^ = 1 1 (via 
feedback links). 

• At the beginning of time slot t, t > 1, each receiver RXj, 1 < j < K, perfectly knows all the channel 
coefficients terminating at RXj (i.e., {hjiit)}^). 

We investigate this channel under the above set of two assumptions which is referred to as delayed CSIT 
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assumption. Let R = (Ri, R2, • • • , Rk) G be a if-tuple of rates corresponding to the transmitter- 

receiver pairs (TXi, RXi), (TX 2 , RX 2 ), • • • , (TX K , RX K ). A (2 rR , r) code of block length r and rate R 
with delayed CSIT consists of K sets of encoding functions {(/?|^ T } 1 < t < r , 1 < i < K, 

J[ : x C***^*- 1 ) ->• C, 

(3) 

^(*)=yS.(w r[,i ,{H(0}ri). i<*<r, 



satisfying the power constraint of Eq. (|2J), together with K decoding functions ipr, 1 < i < K, 

(4) 

W®=^{{ Vi {t)}U)- 

All encoding and decoding functions are revealed to all transmitters and receivers before the transmission 
begins. Defining the average probability of error at RXj for this code as 

1 2 rR i 

Pf} T = P (w® ± W [l] ^j = P (^r 1 ^ W®\W [i] = w) , 1 < i < tf, (5) 

«J=1 

the average probability of error of this code is given by 

P eT 4 max pW. (6) 

i<«<k ' 

A rate tuple R is said to be achievable if there exists a sequence {(2 tR , r)}^_ of codes, for which 
Hindoo P er = 0. The closure of all achievable rate tuples R is called the capacity region of this channel 
with delayed CSIT and power constraint P and is denoted by C(P). 

We consider this channel with P — > 00, and define an achievable sum degrees of freedom (simply called 
"achievable degrees of freedom", or "achievable DoF") as 

Doff (if) = lim E T^S- ^ 

P^oo t-^> logo P 
i=l oz 

The supremum of all achievable DoFs is called the DoF of this channel with delayed CSIT, and is denoted 
by DoPf(K). More formally, 

DoFf(K) 4 lim sup f-^-. (8) 

We indeed consider a more general transmission setup as follows: Fix an integer m, 1 < m < K. Define 
S m as a subset of cardinality m of {1,2, ••• ,K}. Obviously, Sk = {1,2, ••• , K}. For every subset 
S m C {1, 2, • • • , K}, and for every i G S m , TX; wishes to transmit a common message W / '*'' Sm ] G W' 1 ' 5 ™' 
of rate R^ Sm ^ to all receivers RX J5 j G S m . We call P^' 15 ™] an order-m message. The case m = 1 
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represents the interference channel with private messages as described earlier. The codes, probabilities of 
error, achievable rates, capacity region, and degrees of freedom are similarly defined as before, now for a 
K( _j) -tuple of rates. For any 1 < m < K, the DoF (resp. achievable DoF) of transmission of order-m 
messages over the SISO IC with delayed CSIT is denoted by DoF^(iT) (resp. DoF^(iQ). 

For any integers S, K > 2, the discrete-time S x K SISO AWGN X channel is defined by a set 
of S transmitters TXj, 1 < i < S, and K receivers RX J; 1 < j ' < K, with the following input-output 
relationship: 

s 

y j (t) = ^2h ji (t)x i (t) + z j (t), l<j<K, (9) 

8=1 

where the parameters are defined as in Eq. ([T]). The channel input is similarly subject to the average power 
constraint of Eq. Q. The delayed CSIT assumption is defined exactly as in the IC case. Fix an integer 
m, 1 < m < K. For every subset S m C {1, 2, • • • , K}, and for every i G {1, 2, • • • , S}, TXj wishes 
to transmit a common message ty^ 5 ™! £ yyi r \ s ™] f ra te R^ Sm ^ to all receivers RXj, j 6 S m . The case 
m = 1 corresponds to the X channel with private messages. 

The achievable rates, capacity region, and degrees of freedom are similarly defined, now for an SQ- 
tuple of rates. The DoF (resp. achievable DoF) of this channel under delayed CSIT assumption is denoted 
by DoF^(£, K) (resp. DoF^fS*, K)) for 1 < m < K. 

III. Main Results and Discussion 

A. Main Results 

The main results of this paper are formulated in the following two theorems: 

Theorem 1: In the f^-user SISO interference channel with delayed CSIT and K > 2, DoF I 1 c (iC) degrees 
of freedom is achievable almost surely, where DoF l f(K) is obtained by 



Doff (if) 



1 - 



K -2 



K -2 



K(K-l) 2 K-l 



A 2 {K) 



-i 



(10) 



and A 2 (K) is given by 
A 2 (K) ^ - 



4 [4(^-2)2-1] ' Z- o 2(^-^(4^-1) 



2£ 2 + l 



(ID 



Moreover, for 2 < m < K, DoF ^fiQ degrees of freedom is achievable in transmission of order-m 
messages, where 



DpF^(K) 



(K - m)(K - m - 1) 1 (K — m — £ 1 + l)(3£j +£ x -l] 

2m[4:(K - m) 2 - 1] _ 



1 + 



E 

£i=0 



2( J ftT-4)(4^f-l) 



K—m 

n 



2£ 2 + l 



(12) 
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TABLE I 

Achievable DoFs for the SISO interference channel with delayed CSIT 



K 


2 


3 


4 


5 


Our achievable DoF for the i\"-user IC 


1 


36 
31 


45 

38 


1400 
1171 



Proof: See Section IV 



Theorem 2: In the 2 x K SISO X channel with delayed CSIT and K > 2, DoF 1 : f2, K) degrees of 
freedom is achievable almost surely, where 



DpF?(2,#) 



^ 4) (2^ + 1) ^ 2£ 2 

^i=o v i;v i i ; « 2 =ii+i 



1 



(13) 



More generally, for 2 < m < K, DoF ^(2, K) degrees of freedom is achievable in transmission of 
order-m messages, where 

n -l 

(14) 



DoF* (2, if) 



\ _ K ^ (K - m -£,)(£, + 1) X n m 
^ (if-4)(24 + l) 11 



24 



1 



£l=0 V i/V " y ^2=^1 + 1 

Proo/v See Section |V} ■ 
Remark 1: Using scaled versions of the schemes proposed in Sections IV and |v| VDoF I 1 c (K) and 
are achievable in the J\"-user MIMO IC and 2 x K MIMO X channel, respectively, with 
N antennas available at each node and with delayed CSIT, where DoF I 1 c (iT) and DoF ^(2, K) are given 



by Eqs. (10) and (13), respectively. 



B. Discussion 

Our achievable DoFs for the i^-user SISO IC and 2 x K SISO X channel with private messages and 
delayed CSIT are plotted in Figs. [TJ and [2] for 2 < K < 75, respectively. For the sake of comparison, the 
achievable DoF reported in p2| for the K x K SISO X channel with delayed CSIT is also plotted in 
Fig. [2| As it is seen in the figure, for K > 3, our achievable DoF for the 2 x K X channel, i.e., DoFf (2, K) 
presented in Theorem |2| is strictly greater than | — 3 ( 3j ^_ 1 ) which is achieved in [ J2~2~J for the K x K 
X channel. It can be also easily shown that our achievable DoFs are strictly increasing in K, and it is 



proved in Appendix E that, as K — > oo, the achievable DoFs approach limiting values of 
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1.2663 



and ps 1.4427 for the IC and X channel, respectively. Tables [ij and [n] list our achievable DoFs for the 
fT-user IC and 2 x K X channel with delayed CSIT and 2 < K < 5. For K = 3, we achieve |f DoF 



which is greater than the previously reported value of | DoF in [21 1 
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1.28 




3 10 20 30 40 50 60 

K 



Fig. 1. Our achievable DoF for the A"-user SISO interference channel with delayed CSIT and 3 < K < 75. 




Fig. 2. Our achievable DoF for the SISO X channel with delayed CSIT and 2 < K < 75. 
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TABLE II 

Achievable DoFs for the SISO X channel with delayed CSIT 



K 


2 


3 


4 


5 


Our achievable DoF for the 2 x K X channel 


6 
5 


9 
7 


105 
79 


1575 
1163 


Achievable DoF in [I221 for the K x K X channel 


6 
5 


5 
4 


14 
11 


9 
7 



IV. Proof of Theorem 1 

In this section, we prove that DoF ^fiQ, 1 < m < K, stated in Theorem [j] can be achieved in the 
.fT-user SISO IC with delayed CSIT To this end, we first elaborate on our achievable scheme for the case 
of K = 3. We then propose our transmission scheme for the general i\~-user setting. 

Before proceeding with the transmission schemes, let us define some notations which will be widely 
used throughout the paper. We use u^ Sm ' s ^ to denote a symbol which is: 

• available at TXj, 

• available at RXj, for every j E S n , 

• intended to be decoded at RX fc , for every k e S m . 

We refer to u i l \s m -,s n ] as an ^-symbol available at TX;. The order of symbol u ^ Sm ' Sn ^ is defined 
as the ordered pair (m,n) containing the cardinalities of S m and S n , respectively. For instance, n' 2 ' 1 ' 5 ' 3 ' 
is a (1, 5; 3)-symbol of order (2, 1) which is available at TX 2 and RX 3 , and is intended to be decoded at 
both RXx and RX 5 , where the set braces "{" and "}" have been omitted to avoid cumbersome notations. 
For ease of notation, a symbol u ^ Sm ' Sn ^ with S n = {} is denoted by u^ Sm ^ and is called an 5 m -symbol 
of order m. 



A. The 3-user SISO Interference Channel 

Consider the 3-user SISO IC with delayed CSI available at the transmitters as depicted in Fig. [3] In 
order to achieve DoF I 1 c (3) = |f, suggested by Eq. (10), transmission is accomplished in three distinct 
phases. The fresh data symbols are fed to the channel in the first phase. In the remaining phases, extra 
linear equations are delivered to the receivers in such a way that the interference is properly aligned 
at each receiver. At the end of transmission scheme, the receivers are left with the desired number of 
equations in terms of their respective data symbols. 

It is important to point out that we will use several random coefficients during our transmission scheme 
to construct and transmit different channel input symbols. These coefficients are randomly generated 
before the beginning of communication and revealed to all transmitters and receivers. The transmission 
phases are described in detail as follows: 
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• Phase 1 (3-user IC): 

This phase takes 5 time slots, during which each transmitter feeds 4 fresh data symbols to the chan- 
nel. Since in the interference channel there exists no for j ^ i, we simply use instead of 
u^. Let uW = [u^\ u 2 l \ u%\ u^] T denote the vector containing the data symbols of TXj, 1 < i < 3. 
In each time slot, every transmitter transmits a random linear combination of its 4 data symbols. Let 

r "i T 

c^(t) = Ci\t), c 2 l \t), Cg'(t), c$(t) denote the vector containing the random coefficients of the linear 
combination transmitted by TXj, 1 < i < 3, over time slot t, 1 < t < 5, i.e., x; t (t) = (cW(t)) uW. Ignoring 
the noise terms at receivers, the received signal at RXj, 1 < j < 3, in time slot t, 1 < t < 5, is equal to 

%•(*) = hjxifyxxit) + h j2 (t)x 2 (t) + h j3 (t)x 3 (t) 

= h 3l {t) ( C W(t)) T uW + MO (c^fuM + MO (c^fu^. (15) 

Therefore, by the end of phase 1, RXj obtains the following system of linear equations in terms of all 
transmitted data symbols: 

Yj = D^CWuW + D i2 C[V 2 l + D^C^u^ 1 < j < 3, (16) 

where is the 5x1 vector of received symbols at RXj during 5 time slots, Dji is the 5x5 diagonal 
matrix containing hji(t), 1 < t < 5, on its main diagonal, and is the 5x4 matrix containing the 
random coefficients employed by TXj during these 5 time slots, 

CH = [S(1)\S(2)\S(3)\S(4)\S(5)] T , 1 < i < 3. (17) 
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Since the elements of are i.i.d., it is full rank almost surely, i.e., rank(C^) = 4. Furthermore, D 3 -j 
is a diagonal matrix with i.i.d. elements on its main diagonal, and thereby, it is also full rank almost 
surely, i.e., rank(Djj) = 5. Since and are independent of each other, their multiplication is also 
full rank almost surely. This means rank(Qjj) = 4, where Qji = D ^C^, 1 < i, j ' < 3. Since Qjj is a 
full rank 5x4 matrix, its left null space is one dimensional almost surely. As a result, for each (i, j), 
1 < h j < 3, there exists a nonzero 5x1 vector ujji = [cOjn,uiji2,ujjis,ujji4,ujji 5 ] T such that 



QjiUji = 4x i, l<i,j<3. 



(18) 



Note that by the end of phase 1, all transmitters and receivers have access to Q^, 1 < i,j < 3, and 
thus, can calculate ujji, 1 < i,j < 3. Using Eqs. (16) and (18), RXi can obtain 



yfo, 13 = {uWFQnUu + (u [2] ) T Q^i 3 + (i^f 

o 



Similarly, RX 2 can obtain 

y T 2 u 2l = (uP]) T Qf 2 a; 21 + (u^fC^i, 
y^ 23 = (u^Q^s + (u^fQ^s, 



(uW) T Qf 1 u; 13 + (u^fQ^, (19) 
(u^QTi^ + (u^QW (20) 



(21) 
(22) 



and RXi can obtain 



y^ 31 = (u^f Q3> 31 + (u®) T Qj 2 u> 31 , 
yju^ = (u^fQ^ + (uW) T Q^32. 



(23) 
(24) 



If we somehow deliver (uW) t Q£cj 23 , (u^) t Q^ 2 u; 13 , (u^) t Q^ 32 , and ( U [ 3 ]) T Qf 3 w 12 to RXi, then 
it can obtain enough equations to resolve its four desired data symbols as follows: 

• (u[ 1 l) T Q 2 r 1 o; 2 3 and (u^^Q^a^ are two desired equations in terms of 4 x 1 data vector uM. 

• (u^) T Qj 2 iVi3 can be subtracted from y{u) 13 to yield (uN^Q^a^, which is a desired equation in 
terms of uM. 

• (u[ 3 ]) T Qf 3 u;i2 can be subtracted from yfcj 12 to yield (u[ 1 l) T Qf 1 u?i 2 , which is a desired equation in 
terms of uW. 

Therefore, RXi will have a system of four linear equations in terms of 4 x 1 data vector uM, namely, 
(uW) T Q 2 r 1 a;23, (u [1] ) T Q 3 r L W3 2 , (u^) T Q^lj 13 , and (uM^Q^u;^. As we prove in Appendix [XJ these 
equations are linearly independent almost surely, and therefore, RX X can solve them to obtain u^. By 
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a similar argument, having (uM) T Q 21 u; 2 3, (u^) T Qf 2 u>i 3 , (u [2] ) T Q 32 a;3i, and (u [3 ]) T Q2 3 a; 2 i, RX 2 can 
obtain four linearly independent equations in terms of u' 2 ', and so, it can solve them to obtain u' 2 l Also, 
after providing RX 3 with (u^Q^o^, (u [3] ) t QJ 3 lj 12 , (u [2] ) t QJ 2 lj 31 , and (u [3l ) T Q 23 u> 2 i, it can obtain 
enough equations to solve for u' 3 l 

Therefore, our goal in phase 2 boils down to delivering (uM) T Q 21 a;23 an d (u^) T Qf 2 w i3 to both RXi 
and RX 2 , delivering (uW) T Q 3 " 1 u;3 2 and (u^) t Q,J 3 uj 12 to both RXi and RX 3 , and delivering (u^) T Q,l 2 u> 31 
and (u^^Q^u^i to both RX 2 and RX 3 . Therefore, the following order-2 symbols can be defined: 

u Wi,2] A ( u [i])r Q T iUl2s> u [i\i,s] A ( u [i])T Q r W32> (25 ) 
U WA a (u^f Qf 2 u, 13 , M [ 2 I 2 ' 3 ! 4 (u^f Q^i, (26) 
M [3H,3] a (u^f Q^ 12 , y 3 ' 2 ' 3 ! 4 ( u M) T Q^ui 21 . (27) 



Phase 2 (3-wser /C): 



This phase takes 12 time slots to transmit 18 order-2 symbols generated in phase 1. Since we have 
generated only 6 order-2 symbols in phase 1, we simply repeat phase 1 three times to obtain 18 order-2 
symbols required in phase 2. This takes 3x5= 15 time slots and hence, phase 2 begins at time slot 
t = 16. Consequently, at the beginning of phase 2, for every 1 < i, j < 3, % < j, there are three 

order-2 symbols u^ 1 '^ , u 2 ^' j \ and u^ h ^ at TX; and three order-2 symbols uf^' j ^ , u 2 ^' j \ and u^ 1 '^ at 



TXj. The transmission in phase 2 is then carried out as follows: 



In the first time slot of phase 2, TXi transmits a random linear combination of wf' 1 ' 2 ' and u 2 l± '^ while 

[21 1 21 [1 1 1 21 

TX 2 transmits u\ .In the second time slot, TXi transmits another random linear combination of u[ 

[111 21 [2|1 21 

and u 2 ' while TX 2 repeats u[ . TX 3 is silent during these two time slots. After these two time slots, 
every receiver obtains two linearly independent equations in terms of three (1, 2)-symbols uj 1 ' 1 ' 2 ', u\ 1]{1 ' 2 \ 
and wf' 1 ' 2 ' almost surely. Thus, each of RXi and RX 2 in order to resolve these three order-2 symbols, 
needs an extra equation. Consider the equations received at RX 3 during these two time slots: 

ys(t) = MfMO + M*M*) = h 31 (t) (cWW(t)) T vPM + h 32 (t)u? h2] , t = 16, 17, (28) 



,[1|1,2] 



where u^ 1 ' 2 ^ 



[1|1,2] „.[1|1,2] 



[111.2] 



(0,4 1|1>21 (0 



u\ ',u 2 ■ , and ct 1 ! 1 ' 2 !^)^ 
coefficients employed by TXi in time slot t. Now, RX 3 can form 

1 1 



is the 2 x 1 vector of random 



-2/3(16) 



-2/3(17) 



gg (cl .M (16)) '_gg (c ^ (17)); 



u 



[1|1,2] 



(29) 



which is an equation solely in terms of the elements of u' 1 ' 1 ' 2 '. This is the side information that RX 3 
has about the order-2 symbols of RX X and RX 2 , and can provide the extra equation required by both 
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RXi and RX 2 to resolve their order-2 symbols. Based on our terminology, this quantity is denoted by 
M [i|i,2;3] next tWQ t j me s | ots are d e di ca t e d to the transmission of another three order-2 (1, 2)-symbols. 
However, this time, the roles of TX X and TX 2 are exchanged. Specifically, during time slots t = 18, 19, 

[21 1 21 [21 1 21 

TX 2 transmits two random linear combinations of u 2 and u 3 while TXi repeats the same symbol 
M3' 1 ' 2 '. The side information u^ 1,2 ' 3 ^ is similarly formed at RX 3 by the end of these two time slots. 

Up to this point, we have sent 6 order-2 (1, 2)-symbols in 4 time slots, and generated two pieces of 
side information at RX 3 . Analogously, for each of receiver pairs {1,3} and {2,3}, the above procedure 
can be repeated using their respective transmitters. Therefore, by spending another 2x4 = 8 time slots, 
we will transmit 2 x 6 = 12 order-2 symbols and generate the side information m' 2 ' 2 ' 3 ' 1 ! and u^ 2 ' 3 ' 1 ^ at 
RXi, and i^ 1 ! 1 ' 3 ' 2 ! and u^ 1 ' 3 ' 2 ^ at RX 2 . Therefore, our goal is reduced to 

(a) delivering ^I 1 ! 1 ' 2 ; 3 ! and u [2ll ' 2 ' 3] to both RX X and RX 2 , 

(b) delivering u^ 1 * 3 ^ and u^ 1 ' 3 ^ to both RXx and RX 3 , 

(c) delivering u [2 ^ 3 ' l] and u [3l2 ' 3 ' 1] to both RX 2 and RX 3 . 

To this end, consider a random linear combination aiu^ 1 ' 2 ' 3 ^ + a^ 1 ' 1 ' 3 ' 2 '. If we somehow deliver this 
quantity to all three receivers, then 

• RXi obtains a linear equation in terms of its own desired symbols, 

• since RX 2 has u^ 1,3 ' 2 \ it can cancel u^ 1 ' 3 ' 2 ^ to obtain u^ 1,2 ' 3 \ 

• since RX 3 has u^ 1 ' 2 ' 3 ^, it can cancel u^ 1 ' 2 ' 3 ^ to obtain u^ 1,3 ' 2 ^. 

Therefore, axu^ 1 ' 2 ' 3 ^ + a 2 u^ 1 ' 3 ' 2 ^ is desired by all three receivers. By similar arguments, one can conclude 
that /SimI 2 ' 2 ' 1 ' 3 ] + /3 2 -u[ 2 l 2,3;1 l and 7 1 -ul 3 l 1 ' 3 ; 2 ] + 7 2 -u[ 3 l 2 ' 3;1 l are desired by all three receivers, where /3±, f3 2 , 71, 
and 7 2 are random coefficients. According to our terminology, we define the following order-3 symbols: 

^H'M A aiM [lH,2;3] +a2M [l|l,3;2] ) (3()) 
u [2|l,2,3] A /3lU [2|l,2;3] +/32U [2|2 ) 3il] > (31) 
u [3|l,2,3] A 7lU [3|l,3;2] +72U [3|2 1 3;l]_ (32) 

Although delivering i^ 1 ! 1,2 ' 3 ], u^ 1 ' 2 ' 3 ^, and m' 3 ' 1 ' 2 ' 3 ! to all three receivers will provide each of them with 
useful information about its desired symbols as discussed above, it is not still sufficient to achieve the 
goals (a), (b), and (c). To be more specific, recall that RX X needs to obtain both symbols u^ 1 ' 2 ' 3 ^ and 
^I 1 ! 1 ' 3 ; 2 !. Thus, assuming u^ 1 ' 2 ' 3 ^ has been delivered to all three receivers, RXi still needs an extra equation 
in terms of u^ 1 ' 2 ' 3 ^ and u^ 1 ' 3 ' 2 ^. To obtain this extra equation, we notice that by delivering i^ 1 ! 1 ' 2 ' 3 ! to all 
three receivers, both RX 2 and RX 3 will have both symbols i^ 1 ! 1 ' 2 ' 3 ! and u^ 1 ' 3 ' 2 ^. Therefore, any random 
linear combination a^u^ 1 ' 2 ' 3 ^ + a'^W 1 ' 3 ' 2 ' can be considered as the extra equation required at RXi which 



14 



is also available at RX 2 and RX 3 . Therefore, we can define the following (1; 2, 3)-symbol at TXi: 

U m^l 4 a ^[lH,2i3] + ^[111,352] _ (33) 

By repeating the same argument for RX 2 and RX 3 , the following (2; 1,3) -symbol and (3; 1,2) -symbol 
can be defined: 

M [2|2;l,3] A jS / M [2|l,2;3] +/3 / M [2|2,3;l] j (34) 

u [3|3;l,2] A 7 / w [3|l,3; 2 ] +7 / u [3|2,3 i l] ; (35) 

where (3[, /3' 2 , 7 l5 and j' 2 are random coefficients. To summarize, one can achieve the goals (a), (b), and 
(c) if: 

I. wl 1 ! 1 ' 2 ' 3 !, tit 2 ! 1 - 2 ' 3 ], and u^ 1 ' 2 ^ are delivered to all three receivers. 
II. u^ 1;2 ' 3 \ m [2|2;1 ' 31 , and m! 3 ! 3 ; 1 ' 2 ! are respectively delivered to RX^ RX 2 , and RX 3 . 
The goals I and II will be accomplished in the next phase. 

• Phase 3-1 (3-user IC): 



In this subphase, which takes three time slots, we fulfill the goal I as follows: Using time division in 
three consecutive time slots, the three symbols wW 1 ' 2,3 !, u^ 1 ' 2 ' 3 ^, and u^ 1 ' 2 ' 3 ^ will be delivered to all three 
receivers. 

• Phase 3-II (3-user IC): 

In this subphase, the goal II is accomplished in one time slot by simultaneous transmission of symbols 

u [i|i i 2,3] j u [2|2;i,3] > and u [3|3;i,2] by TXi TX ^ and respectively. 

Finally, in order to compute the achieved DoF, we note that a total of 3 x 12 = 36 fresh data symbols 
were fed to the system in phase 1. To deliver these data symbols to their intended receivers, we spent 
3 x 5 = 15 time slots in phase 1, 3 x 4 = 12 time slots in phase 2, three time slots in subphase 3-1, and 
one time slot in subphase 3TI. Therefore, our achieved DoF is equal to 

DoFf (3) = = -. (36) 

1 v ; 15 + 12 + 3 + 1 31 

One finally notes that the proposed transmission scheme starting from the phase 2 was dedicated to 
transmission of order-2 messages to the receivers. Therefore, we have proved that DoF 2 c (3) = 12 H +1 — | 
is achievable in the 3-user IC with delayed CSIT as suggested by Eq. (12). Also, DoF 3 c (3) = 1 was 
trivially achieved using time division in the phase 3-1. 
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Fig. 4. Block diagram of the proposed multiphase transmission scheme for the K-user IC, K > 3. 

B. The K-user SISO Interference Channel 

In this section, we generalize our multiphase transmission scheme to the i^-user SISO IC with delayed 
CSIT and K > 3. The transmission scheme is a multiphase scheme wherein the fresh data symbols are fed 
to the system in phase 1 towards generating order-2 symbols. The remaining phases are responsible for 
generating higher order symbols and finally providing each receiver with appropriate equations to resolve 
its own data symbols. Fig. [4] depicts a high-level block diagram for the proposed multiphase scheme. 

• Phase 1 (K-user IC): 

In this phase, each transmitter transmits (K — l) 2 + 1 random linear combinations of (K — l) 2 data 

r -iT 

symbols in (K— 1) 2 +1 time slots. Let = u±\ • • • , i^ K _^2 be the data vector of TXj, 1 < % < K. 
Define 

C [i] = [ C W(l)|cW(2)| ■ • ■ \c®((K - l) 2 + 1 



1< % < K, 



(37) 



where c^(t) is the (K — l) 2 x 1 vector of the random coefficients employed by TXj in time slot t, 
1 < t < (K — l) 2 + 1. Then, ignoring the noise, after these (K — l) 2 + 1 time slots, RXj receives the 
following vector of (K — l) 2 + 1 channel output symbols: 



y, = D^CNuM + D^CPV 2 ] + ■ ■ • + D^u 



[K] 



1<J<K, 



(38) 



where is the diagonal matrix of size [(K — l) 2 + 1] x [(K — l) 2 + 1] which contains the channel 
coefficients hji(t), 1 < t < (K — l) 2 + 1, on its main diagonal. 

Define Q^j = D^C^, 1 < i, j ' < K. Since and are full rank almost surely and independent 
of each other, their multiplication is also full rank almost surely. Hence, Qji is a full rank matrix of size 
[(K — l) 2 + 1] x (K — l) 2 almost surely, and so, its left null space is one dimensional. Therefore, there 
exist nonzero vectors ujji = [u}jn,Uji2, ■ ■ ■ , (U,-j((x-i)2 + i)] T such that 



(JC-l) 2 xl; 



1 < h 3 < K. 



(39) 
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Thus, for any 1 < j < if and any i G Sx\{j}, RXj can construct 

yJ Uji = J2 (u [i ' ] ) r Q^^ = (ub' 1 ) r Q>,,+ £ (u^fC&a,*. (40) 

i'e5 x \{i} *'e5 K \{i,j} 

We note that (u^) T Q^/U>ji, z' G <SR-\{i,j}, is an equation solely in terms of u^, and thus, it is desired 
by RXj/. It is easy to see that if we deliver all if — 2 quantities (vft'^Qj^u) ^, i' G Sic\{i,j}, to RXj, 



then RXj can cancel their summation from Eq. (40) to obtain (u^) T Q^UJjj, which is a desired equation 



for RXj. Therefore, one can define if — 2 order-2 -symbols available at TXj' by 



u 



[i'WJ] A /■„[<'] \T n T 



u^fQ^,, z'GM^i}- (41) 



Since for a fixed j there are if — 1 choices of i, i G iS>x\{j}, a total of (if — 1) (if — 2) order-2 symbols 
of the form u^ 1 '^, i G Sx\{j}, will be constructed for a fixed j. These symbols, if delivered, will provide 
RXj with if — 1 equations solely in terms of while providing every RXj, i G Sx\{j}, with if — 2 
equations in terms of u^. 

Since there are if choices for RXj, 1 < j < if, a total of if (if — l)(if — 2) order-2 symbols u^ 1 '^, 
i G are generated by the end of phase 1. After delivering all these symbols to their intended pairs 

of receivers, every receiver will be provided with if — 1 + (if — l)(if — 2) = (if — l) 2 linear equations 
in terms of its own data symbols. Namely, RXj will obtain the following (if — l) 2 linear equations in 
terms of u^: 

U.-M'q},^. heS K \{j}, (42) 
(u^fQ^.^, Ma G S K \{j},i 2 + i 3 . (43) 

It is proved in Appendix |a| that these (if — l) 2 equations are linearly independent almost surely, and thus, 
each receiver can resolve all its (if — l) 2 data symbols. 



K(K-\)(K-2) 
DoF' 2 C W 

intended pairs of receivers. Hence, one can write 



Finally, it takes DoF iC(jf) ti me slots t0 deliver all the order-2 symbols generated in phase 1 to their 



DoFf (if) = ^ 1 WW¥ - (44) 

_ ]_)2 _|_ l _|_ K(K-l){K-2) 



DoFiC(X) 

Phase m-I, 2 < m < if — 1 (K-user IC): 



This subphase takes a total of N^~ l order-m symbols of the form u^ Sm \ S m C Sk, i G S m , and transmits 
them to the receivers in time slots. Then, a total of N^+i order-(m+ 1) symbols of the form u^ Sm+1 \ 
S m+ i C S K , i G S rn+ i, together with symbols of the form u^ r ' Sm+1 ^\ S m+1 C S K , i G S m+ i, are 
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generated such that if the generated symbols are somehow delivered to their intended receiver(s), then 
every subset S m of cardinality m of receivers will be able to decode all the 5 m -symbols transmitted in 
this subphase. The parameters N 1 ^' 1 , T^, N^ ± , and N^+\ are given by 

N™ = m[2(K - m) + 1] {^j , (45) 
T^ = m(K-m + l)(^j, (46) 

^ = (-'-D( m ^ 1 ), (47) 
N l ^\ = {m + l)(_ K \. (48) 



„,[n|<Sm] „[u|<S m ] ..[n|«Sm] 
"1 5 "2 ) ' ' ' 5 a K-m+l 
T 



[i2\S m ] [i2\S m ] ..[i2\S m 
1 i a 2 i ' ' ' i a K-m 



of K — m 



The following is a detailed description of this subphase: 

Fix S m C Sk and sort the elements of S m in ascending cyclic order. Fix i x E S m and let i 2 E S m be the 
element immediately after i\ in that ordering. Consider vector u' 41 ! 5 " 1 ] = 

of K — m + 1 <S m -symbols available at TX il and vector u^l 5 " 1 ' = 
5 m -symbols available at TX i2 . In the first K — m + 1 time slots of this subphase, TX il and TX; 2 transmit 
K — m + 1 random linear combinations of elements of u^ 1 ' 5 "*' and u^ Sm \ respectively, while the rest of 
transmitters are silent. Let c^ Sm ^(t) (resp. c^ Sm ^(t)) be the (K — m + 1) x 1 vector (resp. (K — m) x 1 
vector) of the random coefficients employed by TX^ (resp. TXj 2 ) in time slot t, 1 < t < K — m+1. 
Then, ignoring the noise, by the end of these time slots, RX^, 1 < j < K, will have the following vector 
of K — m + 1 channel output symbols: 

Yj = D jil C [il| ' Sml u [il| ' Sml + D ji2 C [<a|5m] u [i2|Sml (49) 
= Q jh u^ s ^ + Q ji2 uM s ™\ (50) 

where C [hlSm] and C [i2lSm] are defined as 

C [h\s m ] A [ C [<i|s m ](i)| c [ii|5 m ](2)| . . . \c [hlSm] (K - m + l)f , (51) 
C [i2\s m ] a [ c fo\S™\(i)\ c [i*\Srn}(2)\ . . . \d»\ Sm \K - m + 1)] T , (52) 

Djjj and T)j i2 axe the diagonal matrices of size (K — m+1) x (K — m + 1) containing the channel 
coefficients h^i) and hj i2 (t), 1 < t < K — m+1, on their main diagonal, respectively, and and 
Q ji2 are defined as = B jh C^ s ^ and Q ji2 = D^C^M 

Therefore, in specific, each receiver RXj, j E S m , obtains K — m + 1 desired linearly independent 
equations in terms of the 2(K — m) + 1 transmitted iS m -symbols, and thus, needs K — m extra equations 
to resolve all the transmitted 5 m -symbols. It is easily verified that Qji 2 , 1 < j < K, is a full rank matrix 
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of size (K — m + 1) x (K — m) almost surely, and so, its left null space is one dimensional. Specifically, 



there exist nonzero vectors u)ji i2 such that 

Qj, i2 u fi2 = 0, f E S K \S m . (53) 

Hence, each receiver RX^, f E SK\S m , can construct y^,ujj> i2 = (u^ Sm ^) T Qj ril ui jt i2 which is a linear 
combination in terms of u^ 1 ! 5 ™] and thus, if delivered to all receivers RXj, j E S m , can provide each of 
them with an extra equation in terms of their desired 5 m -symbols. On the other hand, the above linear 
combination is solely in terms of u^l 5 "^ (available at TX ?1 ) and the channel coefficients (available at 
TX^, due to the delayed CSIT assumption, by the end of these K — m + 1 time slots). Therefore, based 
on our terminology, one can define 



u 



[n|«W] A ( u N^]f Q T iiU; ., i2) f e (54) 



After delivering all these side information symbols to all receivers RXj, j E S m , each of them will obtain 
K — m + 1 linear equations in terms of the K — m + 1 transmitted 5 m -symbols. Namely, RXj, j e S m , 
will obtain the following equations: 

Q jil u [illSml + Q,-i 2 u [i2|5m] (55) 



u 



[h\S m ]\T n T 



Qj'hUj'h, f e S K \S m . (56) 



It is shown in Appendix [B] that the above equations are linearly independent almost surely, which enables 
RXj to solve them for u [i '^ Sm] and u [i2|5m] . 

We repeat the same procedure for every choice of i x E S m , i.e., for each choice, we spend K — m + 1 
time slots to transmit 2(K — m) + 1 (S m -symbols and generate K — m side information symbols. This 
implies the transmission of a total of m[2(K — m) + 1] iS m -symbols in m{K — m + 1) time slots and 
generation of m{K — m) side information symbols. Since S m C Sk could be any subset with cardinality 
m, we transmit a total of iV^-" 1 order-m symbols in time slots and generate m(K — m) (^) side 



information symbols, where A^^-" 1 and are given by Eqs. (45) and (46). 

In order to deliver the generated side information symbols to their respective intended receivers, fix a 
subset S m+ \ C Sk and an index %\ E <S TO+ i. For every j' E S m+ i\{ii}, we have generated exactly one 
side information symbol ■uH'^+AO' };/]_ Since there are m different choices for j', j' E S m +i\{ii}, we 
can identify m symbols of the form w^l^+AO'};/] f or fixed S m+ i C Sk and i\ E <S m+ i. Moreover, every 
receiver RXj/, j' E S m+ i\{ii}, has exactly one of these m symbols and wishes to obtain the rest, while 
RXj x wishes to obtain all the m symbols. Therefore, if we deliver m — 1 random linear combinations of 
these m symbols to all receivers in S m+ i, then each of them (except for RX^) will remove its known 
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side information and obtain m — 1 linearly independent equations in terms of the m — 1 desired symbols 
almost surely and hence, decode all desired symbols. Thus, we define m — 1 5 m+ i-symbols as follows 



p m+1 ]A af 1 l 5 -+ 1 \0'};/] u [i 1 |5 m+1 \{i'} ; /] ) l<£< m -l, (57) 

j'e5 m+ i\{ii} 



where a^ Sm+1 ^ ^ f G <S m+ i\{ii}, 1 < £ < m — 1, is a random coefficient. 

Since RX. ;i wishes to obtain all the m symbols i^il 5 ™+A{i'};i'] 5 f G <S m+ i\{ii}, after delivering the 
above m — 1 linear equations to RX ix , it still requires one extra linearly independent equation to resolve all 



its desired symbols. However, recall that after delivering all the 5 m+ i-symbols defined in Eq. (57) to all 
receivers RXj/, f G S m+ i, every receiver RXj/, f G <S m +i\{ii}, will be able to obtain all the m symbols 
u bi\s m +i\{j'};j'] ^ j> e «S m+ i\{zi}. Thereafter, any linear combination of the symbols u^ Sm+1 ^ j '^' j '\ f G 
S m+ ±\{ii}, will be available at every receiver RXj/, j' G S m+ i\{ii}. In specific, we can define a new 
random linear combination 

u [»i|*iA»+i\{ii}] A ^ a [^\ s ^+i\{f}d'] u [ii\s m +i\{j'};j']^ ( 58 ) 

as a symbol which is available at TX^ and at every receiver RXj/, f G <S m+ i\{ii}, and is desired by 
RX^. 

Since there are ( rn ^ 1 ) choices of S m+ i C Sk, and m+1 choices of i\ G S m+ i for each S m +i C Sk, 
a total of N^+i order-(m + 1) 5 m+1 -symbols and order-(l,m) (ix, <S m+ i\{ii})-symbols will be 



generated where and are given by Eqs. (47) and (48). If we deliver all the 5 m+ i -symbols 

and (zi; <S TO+ i\{ii})-symbols, S m +i C Sk, H G S m +i, defined in Eqs. (57) and (58) to their intended 
receiver(s), then each receiver will be able to decode all its desired order-m symbols transmitted in this 
subphase. This will be accomplished during the next phases. 

• Phase K-I (K-user IC): 

In this subphase, in each time slot, an order- K symbol of the form u^ Sk \ i G Sk, is transmitted by 
TXj while the other transmitters are silent. After each time slot, ignoring the noise, each receiver receives 
the transmitted symbol without any interference. This implies that 

DoF_a C (^) = 1. (59) 

• Phase m-II, 3 < m < K (K-user IC): 



In this subphase, each time slot is dedicated to transmission of the order-(l,m — 1) symbols u 



i\i;S m \{i}\ 
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i G S m , for a fixed S m , S m C <Srt- In specific, in the time slot dedicated to S m , every transmitter 
TXj, i G «S m , transmits u^ r ' Sm ^\ simultaneously. Since each receiver RXj, j G S m , has all symbols 
«' i l' i5m \W, i G 5 m \{j}, it will decode its desired symbol (i.e., u^ j;Sm ^ j ^) after this time slot. If we 
denote by DoF ^" n (i^) the achievable DoF of transmitting all (z; iS m \{i}) -symbols over the K-user SISO 
IC with delayed CSIT, then one can write 



DoF^" n (K) = m, 3<m<K. 



(60) 



Combining Eqs. d45J) to (48) and (60), we conclude that 



DpFjM 



N, 



IC-I 



N icu M ic-i 

rplC j_ iV m + l I Jv m + 1 



[2(K-m) + l]Q 



m\ 



m(JT-m + l)0 + - — — + 
m[2(fC-m) + 1] 

/ i i \ i K—m i (to— l)(Jf— to) 

m(K - m + 1) + ^rrf + 



2 < m < K 



(61) 



In Appendix [Cj it is shown that Eq. (12) is a closed form solution to the recursive Eq. (61) with the 



initial condition ( p9[ ) and 2 < m < K. As a result, for m = 2, it is shown that 

DoFjp(lO = ' 



(62) 



where A 2 (i^) is given in Eq. (11). Equation (10) immediately follows from Eqs. (11), (44) and (62). 



V. Proof of Theorem 2 



For K = 2, our transmission scheme reduces to a modified version of the scheme proposed in [22] and 



achieves the same DoF of |. Hence, we would rather start with K = 3 and elaborate on our transmission 



| and 



scheme for the 2 x 3 X channel with delayed CSIT. We show that it achieves DoF f (2, 3) 
DoF * (2, 3) = |, as suggested by Eqs. (13) and (14). Finally, we will proceed with the general 2 x K 



case. 



A. The 2x3 5/50 X Channel 

In this section, we prove that DoF_f (2, 3) = f and DoFff2, 3) = | are achievable in the 2 x 3 SISO X 
channel with delayed CSIT which is depicted in Fig. |5j To this end, we propose a transmission scheme 
which has three distinct phases: 

• Phase 1 (2 x 3 X Channel): 
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This phase takes 9 time slots to transmit 15 data symbols as follows: Fix i\ = 1 and i 2 = 2. During the 
first 3 time slots, 5 data symbols u^ 1 ! 4 [ u f l]1] , uf ]l \ uf ]l] ] T and u^ 1 ! = [u\^\u\^ 1] ] T (all intended 
for RXi) are transmitted by TX^ and TX i2 , respectively. In specific, in each of these 3 time slots, TX^ 
transmits a random linear combination of Ui , itf » and wjj while TX i2 transmits a random linear com- 
binationof M f 2|1] and u' ia|1] . Let c^ 1 ^) 4 [cf l|1] (t), i n|1] (t), 4 il|1] (t)] T and c^W (t) 4 [cf 2|1] (i), c| 2,1] (t)] T 
denote the vectors containing the random coefficients of the linear combinations transmitted by TX^ and 
TXj 2 , respectively, over time slot t, 1 < t < 3. 

After these 3 time slots, every receiver obtains 3 linearly independent equations in terms of the 5 
transmitted data symbols almost surely. Thus, RXi in order to resolve these 5 desired data symbols, needs 
two more linearly independent equations. Now, consider the equations received at each of RX 2 and RX 3 
in time slot t, 1 < t < 3: 

2 

k=l 
2 

= Y,h ]lk (t){c^(t)) T u^ 1 \ j = 2,3. (63) 

k=l 

The system of linear equations received at RXj, j = 2, 3, by the end of these 3 time slots can be written 

as 

2 

y^^D^C^V^, j = 2,3, (64) 

k=l 

where y 3 -h is the 3x1 vector of received symbols at RXj during these 3 time slots, Dj ifc |i is the 3x3 
diagonal matrix containing hj ik (t), 1 < t < 3, on its main diagonal, and C' n W (resp. C^ 2 ' 1 ') is the 3x3 
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(resp. 3x2) matrix containing the random coefficients employed by TX^ (resp. TXj 2 ) during these 3 
time slots, i.e., 

c fc|i]A^h|i]( 1 )| c h|i]( 2 )| c fc|i](3)] T ; k = 1,2. (65) 

Since the elements of C^ 1 ' 1 ' and C'* 2 ' 1 ] are i.i.d., they are full rank almost surely, i.e., rank(C^ 1 ' 1 l) = 3 
and rank(C fe|1] ) = 2. One can verify that D^m is also full rank almost surely and is independent of 
Q[«fc|i]_ Therefore, Qji fc |i = D^xC^' 1 ] is full rank almost surely. Specifically, Qji 2 \i is a full rank 3x2 
matrix, and thus, its left null space is one dimensional almost surely. Let the 3x1 vector u>ji 2 \i be in the 
left null space of Q^i, i.e., 

Qiiali^iMli = °2xi, j = 2,3. (66) 



After these 3 time slots, every receiver can calculate u>ji 2 \i, j = 2,3. Then, using Eqs. (64) and (66), 
RXj, j = 2,3, can obtain 

yj {1 u M i = (u^WfQ^n^n + (u [i2|11 ) T Qji 2 |i^i 2 |i 



which is an equation solely in terms of u^ 1 ' 1 '. Therefore, if we somehow deliver (u^^Q^^o;.^!, 

j = 2,3, to RX l5 then it will have enough equations to resolve its 5 desired data symbols (it can be 

easily shown that these equations are linearly independent almost surely). Hence, two symbols u^ 1 ' 2 ^ and 
M [n|i;3] can b e d e fl ne d as 



u 



[iiliy] A /„[ii|i]\T n r 



u l,l|XJ ) 'Qjnii^H, .7 = 2,3. (68) 



In the same way, the following 5 fresh data symbols (now, all intended for RX 2 ) are transmitted during 
the next 3 time slots: 

u^A^l^fel^iiMjT (69) 

u hi2] ± [u [m^[h\2} ]T ^ (70) 

and the following two side information symbols are generated: 



u 



[h\2;j] A („[ii\2]\T n T 



u^^) J Qjn|2^ 2 |2, J = l,3, (71) 



where Qj h \ 2 and u>j i2 \ 2 are similarly defined. 
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The same procedure is followed during the last 3 time slots to transmit another 5 fresh data symbols 

u^' 3 ^ [«f l|3 US l|3 Uf l|3] ] T , (72) 
u [* 2 |3] A [M p] )M g 2 |3]]r (?3) 

which are all intended for RX 3 , and generate the two side information symbols 

u [u|3;i] A (ulnl^TQT^^ ,. 2|3; i = lj2j (?4) 

with similar definitions of Qj^^ and tfjj 2 |3- 



After these 9 time slots, if we deliver the side information symbols defined in Eqs. ( [68] ), (j7Tj) and f74| ) 
to their respective receivers, then each receiver will be able to decode all its own 5 data symbols. To 
this end, consider the linear combination ui 11 ' 1 ' 2 ' + u^ 2]1 \ If we deliver this linear combination to both 
RXi and RX 2 , then RXi can cancel u^ 2 '^ to obtain u^ v,2 K Similarly, RX 2 can cancel u^ 1 '^ to obtain 
M [u|2;i] jsj ote a i so that both uN 1 ; 2 ] and tJ n l 2;1 ] are available at TXj 15 and so is their summation. Therefore, 
one can define the following order-2 symbol available at TX^: 

u [n\l,2] A u [n|l;2] +U N2;1]_ (75) 

The following order-2 symbols can be similarly defined: 

u [h\l,3] A w [n|l;3] +U [n|3;l] ) (76) 
u [ii[2,3] A u [<i[2;3] +U [i 1 [3 i 2]_ (77) 

Our goal in phase 2 is to deliver the above three order-2 symbols to their respective pairs of receivers. 
• Phase 2 (2 x 3 X Channel): 

This phase takes 12 time slots to transmit 18 order-2 symbols generated in phase 1. Recall that in phase 
1 we generated only three order-2 symbols v} 11 * 1 ' 2 *, w- 1 ^ 1 ' 3 ', and u^ 2 ' 3 ^ which are all available at TX^, 
where i t = 1. As we will see later, the following 18 order-2 symbols are required for phase 2: 

«f' 2 UF' 3 Uf' 31 , 2 = 1,2, l<k<3. (78) 

Therefore, we repeat phase 1 three times with (21,22) = (1,2) and three times with (ii,^) = (2,1) 
to generate the above 18 order-2 symbols required for phase 2. The transmission in phase 2 is then 
accomplished as follows: 

The first 4 time slots of phase 2 are dedicated to transmission of 6 (1, 2)-symbols {u^ 1,2 ^}l =1 and 
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{ u !f }|=i- This is accomplished in exactly the same way as the first 4 time slots of phase 2 in 



Section IV-A, and the side information symbols wW 1,2;3 l and u^ 1 ' 2 ' 3 ^ will be generated at RX 3 . Similar 



to phase 2 of Section IV- A, the next 8 time slots are dedicated to transmission of 6 (1, 3)-symbols and 



6 (2, 3)-symbols. However, in contrast to Section IV-A the (1, 3)-symbols and (2, 3)-symbols are here 



transmitted by TX X and TX 2 . Hence, after these 8 time slots, the side information u^ 2,3 ' 1 ^ and u^ 2 ' 3 ' 1 ^ 
will be generated at RX X and the side information u^ 1 ' 3 ' 2 ^ and ui 2 ! 1 ' 3 ; 2 ] will be generated at RX 2 . 
Therefore, after these 12 time slots, our goal is reduced to 

(a) delivering u Wl > 2]3] and ut 2 ! 1 ' 2 ; 3 ! to both RX X and RX 2 , 

(b) delivering u^ 1 ' 3 ' 2 ^ and u^ 1 ' 3 '^ to both RXx and RX 3 , 

(c) delivering u W2 > 3 > 1] and u [2]2 ' 3 '< 1] to both RX 2 and RX 3 . 

Now, consider ui 1 ! 1 ' 2 ; 3 ], ^I 1 ! 1 ' 3 ; 2 !, and u^ 2 ' 3 ' 1 ^. Note that these three symbols are available at TXi, and so 
is any linear combination of them. Another observation is that each receiver has exactly one symbol out 
of these three symbols and requires the other two. Hence, if we deliver two random linear combinations 
of these three symbols to all receivers, then RXi can remove u^ 2 ' 3 ' 1 ^ from the two linear combinations 
to obtain two random linear combinations solely in terms of u^ 1 ' 2 ' 3 ^ and it' 1 ' 1 ' 3 ' 2 !, and so, solve them for 
^I 1 ! 1 . 2 ; 3 ] an( j ^I 1 ! 1 . 3 ; 2 ! Likewise, RX 2 (resp. RX 3 ) can remove u^ 1 ' 3 ' 2 ^ (resp. u^ 1 ' 2 ' 3 ^) from the two random 
linear combinations and obtain two random linear equations solely in terms of its own pair of desired 
symbols, and resolve its desired symbols. Thus, the following two random linear combinations can be 
considered as order-3 symbols to be delivered to all three receivers in the next phase: 

4 1|1A3] 4 a lU W>W + a 2 u^ 3 ^ + a 3 u^\ (79) 
uf 1 '^ 4 a ' iU mm + afaWVM + a' 3 u^ 2 ^. (80) 

Using the same arguments for ii[ 2 l 1,2;3 l, u^ 1 ' 3 ' 2 *, and «[ 2 I 2 > 3;1 ], one can define the following order-3 symbols: 

u [2|l,2,3] A ft^lW] + p 2U [^] + ^[212.3;!], (81) 

4 2 ! 1 ' 2 ' 3 ] A fi > iU \W] + p' 2U iW\ + feuW 2 ^, (82) 

where and fy, 1 < i < 3, are random coefficients. 
• Phase 3 (2 x 3 X Channel): 

Using time division in 4 time slots, the 4 order-3 symbols 1 , w^ 1 ' 1 ' 2 ' 3 ^, uf^' 2 ' 3 \ and u 2 2 ' 1,2 ' 3 ^ will 
be delivered to all three receivers. 

At the end, in view of the fact that we have fed a total of 6 x 15 = 90 fresh data symbols to the system 
in 6 x 9 = 54 time slots in phase 1, and spent 12 time slots in phase 2 and 4 time slots in phase 3, the 
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Fig. 6. Block diagram of the proposed multiphase transmission scheme for the 2 x K X channel, K > 2. 



achieved DoF is equal to 



DoF*(2,3) 



90 



54 + 12 + 4 

Also, regarding the phases 2 and 3, we have DoF f (2, 3) - |N 



9 
7' 



12+4 



, and DoFf (2,3) = 1. 



(83) 



B. The 2 x A SISO X Channel 

Our transmission scheme for the 2 x A SISO X channel with delayed CSIT is a multiphase scheme as 
depicted in Fig. [6j In particular, for every m, 1 < m < A — 1, phase m takes iV* order-m symbols of the 
form u^ Sm \ S m C Sk, i G {1, 2}, and transmits them to the receivers in 77* time slots. Then, a total of 
N* +1 order-(m + 1) symbols of the form u^ Sm+1 \ S m+ i C Sk, i £ {1, 2} are generated such that if the 
generated symbols are somehow delivered to their intended receivers, then every subset S m of cardinality 
m of receivers will be able to decode all the S m - symbols transmitted in phase m. The parameters N*, 
T*, and iV* +1 are given by 

'IC 



N* = 2[2(K-m) + l] 



m 



Tl = 2{K-m + l) 



N x n 

iv m+l 



2m 



( K ) 

\m + lj 



K 



m 



(84) 
(85) 
(86) 



The following is a detailed description of phase m: 
• Phase m, l<m<K — l(2xKX Channel): 

Fix z'i = 1 and %2 = 2. For every S m C Sk, consider the following two vectors of 5 m -symbols: 

1 T 



u [il\S m ] 


A_ 


~.[il\Sm] 
"l 


„.[*l|Sm] 
) u 2 ) ' 


[«l|5m] 

' > u K-m+l 


U [«2|5m] 


A_ 


„\ii\S m ] 

"l 


[i2|5 m ] 
) u 2 ) ' 





(87) 
(88) 



and transmit them exactly as the phase m-I of Section IV-B More specifically, in K — m + 1 time slots, 
TXjj and TX i2 transmit A" — m + 1 random linear combinations of elements of u^l 5 ™! and u^ Sm \ 



respectively. Using the same arguments as in the phase m-I of Section IV-B K — m side information 



symbols of the form u^ Sm '^'\ f 6 SK\S m , are generated after these A — m + 1 time slots (see Eq. (54)) 
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If we somehow deliver all symbols u^ Sm '^\ f G SK\S m , to every receiver RXj, j G S m , then every 
receiver RX, , j G S m , will be obtain enough linearly independent equations to decode all the <S m -symbols 
in u^ 1 ' < ^ m l and u^ 2 '^™]. 

Therefore, for every S m C Sk, a total of 2{K — m) + 1 5 m -symbols are transmitted in K — m + 1 
time slots, and K — m side information symbols are generated. Since there are ( K ) choices of S m C Sk, 
this implies the transmission of [2(K — m) + 1]( ) order-m symbols in (K — m + 1)(^) time slots 
and generation of (K — m) ( K ) side information symbols. Now, in order to deliver the generated side 
information symbols to their respective intended receivers, fix a subset S m+ \ C Sk- For every j' G S m+ i, 
we have generated exactly one side information symbol ttN 5m + 1 \{i'};i 1. Since there are m + 1 different 
choices for j', j' G 5 m +i, we can identify m+1 symbols of the form u^ Sm+1 ^'^ ' for a fixed <S m+ i C 5a-. 
Moreover, every receiver RX,-/, j' G <S m+ i, has exactly one of these m + 1 symbols and wishes to obtain 
the rest. Therefore, if we deliver m random linear combinations of these m + 1 symbols to all receivers 
in «S m+ i, then each of them will remove its known side information and obtain m linearly independent 
equations in terms of the m desired symbols almost surely and hence, decode all desired symbols. Thus, 
we define m 5 m+ i-symbols as follows: 

U lh\s m+1 ]A 0p s ^\(^\l^rn + iWhf] 7 \<i<m, (89) 

where pf\ s ™+^'^'\ f e S m+1 , 1<£< m, is a random coefficient. Since there are ( m+1 ) choices of 
S m+ i, S m+ i C Sk, a total of order-(m + 1) symbols will be generated as above. 

Finally we note that, so far, we have only generated order- (m+ 1) symbols of the form u^ Sm+1 \ with 
%\ = 1, which are all available at TXi. However, in order for phase m + 1 to work, we need order-(m + 1) 



symbols of both forms u^ Sm+1 ^ and u^ Sm+1 K This can be seen from Eqs. (87) and (88). To resolve this 



issue, we simply repeat phase m with (ii,^) = (2, 1). This together with the previous round of phase 
m implies the transmission of a total of order-m symbols in time slots, and generation of N* +1 
order-(m + 1) symbols, where N*, T*, and A^ +1 are given by Eqs. (84) to (86). If we deliver all these 



<Sm+i-symbols to their intended subsets of receivers, then each receiver will be able to decode all its 
desired order-m symbols transmitted in this phase. This will be accomplished during the next phases. 

• Phase K (2 x K X Channel): 

In this phase, in each time slot, an order-K symbol of the form u^ Sk \ i G {1,2}, is transmitted by 
TXj while the other transmitter is silent. Therefore, 

Dof£(2,K) = l. (90) 
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Finally, using Eqs. (84) to (86), we can express DoF ^(2, K), the achieved DoF of transmission of 
order-m symbols in the 2 x K SISO X channel with delayed CSIT, as 



DoFfn(2,^) 



T x + 

m 1 



N x 



DoF^+i(2,^) 

2[2{K-m) + l]Q 



2m 



DoF^+i(2,^) 

(m+ l)[2(iT-m) + 1] 

m(K— m) 



Km< K -1. 



(91) 



(m + l)(ir-m + l) + g ^ 
It is proved in Appendix |d| that Eqs. ( 13 ) and ( 14) are indeed closed form expressions for DoF ^(2, K), 



1 < m < K, satisfying the recursive Eq. (91) together with the initial condition (90). 



VI. Conclusions 

We proposed new multiphase interference alignment schemes and obtained new achievable results on 
the DoF of the Abuser SISO interference channel and 2 x K SISO X channel under delayed CSIT 
assumption. Our results show that the DoF of these channels with the outdated CSI at transmitters is 
strictly greater than that with no CSIT. The achieved DoFs were shown to be strictly increasing in K and 
approach limiting values of 61n ^_ 1 and r^, respectively, for the interference and X channels as K — > oo. 
This is in contrast to the no CSIT assumption wherein it is known that both channels have only one DoF 
for all values of K. For the interference channel, we improved the best previously known result on the 
DoF of the 3-user case with delayed CSIT, and to the best of our knowledge, this paper presents the first 
DoF results for the if-user case with K > 3. For the 2 x K X channel, our achievable DoF is strictly 
greater than the best previously reported result on that of the K x K X channel. 

In the lack of tight upper bounds, no optimality argument can be made; however, it is conjectured that 
the DoF of both the f^-user IC and S x K X channel with delayed CSIT is bounded above by a constant 
(i.e., it does not scale with number of users). 

Appendix A 

Proof of Linear Independence in Phase 1 for the K-user IC 

In this appendix, we show that after phase 1 of the proposed transmission scheme for the K-user SISO 
IC with delayed CSIT, the [K — l) 2 linear equations obtained by each receiver in terms of its data symbols 



are linearly independent almost surely (see Section |IV-B[ Eqs. ( |42| ) and (|43|)). To this end, consider the 
aforementioned equations at RXj, 1 < j < K: 



h e S K \{j}, 



(92) 
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(u b] ) T Q,f 2j Ui 2i:i , i 2 , is e S K \{j}, i 2 ^ is, 



(93) 



which are equivalent to the system of linear equations (u^) T P^, where P^'l is a (K — l) 2 x (K — l) 2 
matrix defined as 



(94) 
(95) 



Let hij denote the vector of length (K — l) 2 + 1 containing the main diagonal of Dy and define 
Vi = [ 1, 1, ■ ■ ■ , 1J T . Then, one can write 



I 



(96) 



where 



Hbl A 



eS K \{j} 



(97) 
(98) 



and "o" denotes the element-wise product operator. Recall that QJ^lj j lh = (0 H ^) T 'Dj lil ijjj lil = 0(k-i) 2 xi- 
Hence, the vector T>j lil (jjj lil lies in the left null space of C^ 1 '. However, is a random [(K — l) 2 + 
1] x (K — l) 2 matrix, and thus, it is full rank almost surely and its left null space is one dimensional, 
denoted by the nonzero unit vector n^. It immediately follows that, for every ji e Sk\{h}, there exists 
a nonzero scalar such that T>j lil u>j lil = a^n^, or equivalently, = a^D^n'' 1 '. Note that 
Djjjj is full rank, and so, invertible almost surely. Therefore, fi^'l can be rewritten as follows 



(99) 



Since a^'s are nonzero and each of them scales a whole column of o flW, they do not affect the 
rank. Hence, 



rank(H [il o Cl^) = rank(H bl o [Dj^n^] 



eS K \{j},neS K \{h} 



)■ 



(100) 



One also can write 



«ie5if\{i}Jie<Sx\{u} 



gbl o N b1 o (H [j 



$b1 o (Hb1)°(-i) ) 



bh°(-i) 



(101) 
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where 



h 



(102) 

J ne5 J f\{j}jie5 K \{«i} 



N^h^LJ,^, (103) 
$M4j I H oN M ) (104) 

and (H^'l)^- 1 ) denotes the element- wise inverse of Hbl. We note that H^l and are independent of 
each other, since is a function of {C^} iie s K \{jy which are independent of H^. Also, and 
are independent of each other, since the channel coefficients are i.i.d. across the transmitters and receivers. 
Hence, <fr^ is independent of H^. 

On the other hand, it can be easily verified that the elements of H^, and thereby (H^l)^ -1 ), are i.i.d.. 
Also, it is easy to show that all elements of <&^1 are nonzero almost surely. Therefore, for any given 
<&^, the elements of o (H^l)^- 1 ) are also independent of each other, since <fr^ is independent of 
(Hb1)°M). xhis implies that, for any given <&KI, <&b1 o (H^])^ -1 ) is full rank almost surely. This means 
that o (Hb1)°(-i) is full rank almost surely. 

Finally, we note that is independent of H^, N^I, and HP\ and thereby, of H^l o fi^l. Therefore, 
regarding Eqs. (96), ( 100 ) and ( 101 ) and applying Lemma [T] one can conclude that P^l is full rank almost 



surely. 

Lemma 1: Let A mxn and B nxm be two independent (not necessarily i.i.d.) random matrices with 
continuous probability distributions and let m < n. If A and B are full rank almost surely, then AB is 
full rank almost surely. 

Proof: If m = n, then the lemma is obviously true. Assume m < n. Let a^, 1 < i < n, and b,, 
1 < j < m, be the ith and jth column of A and B, respectively. Then, the jth column of AB can be 
written as Ym=i Now, assume a linear combination of the columns of AB are equal to zero, namely 

m n 
j=l i=l 

Therefore, exchanging the order of the summations, we have Y^!i=i (j2]=i Ij^ji) a ^ = Omxi- This can be 
written in matrix form as follows 

/ m \ 

^ mxl . (106) 




Thus, the vector Y2T=i ifoj either is equal to zero or lies in the null space of A. In the former case, we 
get jj — 0, 1 < j < m, since B is full rank almost surely. In the latter case, since A is full rank almost 
surely, its null space is n — m dimensional. Let N nx ( n _ m ) = [n 1; n 2 , • • ■ , n n _ m ] denote the basis of the 
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null space of A. Then, there should exist 1 < i < n — m, such that 



3=1 



(107) 



£=1 



Note that N is independent of B, since A and B are independent of each other. Consider the square matrix 
[B|N]„ xn . Since B and N are full rank almost surely (with continuous distributions) and independent of 



each other, one can easily show that [B|N] is full rank almost surely. This together with Eq. (107) yields 
to 7j = 0, 1 < j < m, and & = 0, 1 < i < n — m. ■ 

Appendix B 

Proof of Linear Independence in Phase m-1 for the J^-user IC and Phase m for the 

JC-user X Channel 



Consider the following system of linear equations: 



T l 2 1 



f G S K \S m . 



(108) 
(109) 



which are equivalent to the system of linear equation (u^ Sm ^) T G^\ where G^ and u^™] are defined as 



q[j] A 





" (Qin) T 






. (Q„ 2 ) T 


O 



u 



[S m ] A 



(110) 

(111) 



Note first that, by definition, = D^C^ 1 ' 5 ™ 1 and Q ji2 = D ji2 C [i2|lSml . These matrix multiplications 
are nothing but scaling the columns of C^ 1 ' 5 "^ and C'* 2 ' 5 ™! by the diagonal elements of and D^ 2 , 
respectively. Since the diagonal elements of and Dj i2 are nonzero almost surely and since scaling 
the columns of a matrix by nonzero factors does not affect its rank, one can write 



rank(Q iil ) = rank(C [n|lSm] ) =K-m + l, 
rank(Q ii2 ) = rank(C NlSm] ) = K - m. 



(112) 
(113) 



Also, if a linear combination of some columns is added to a (nonzero) scaled version of a column in a 
matrix then its rank does not change. Therefore, if we replace the K — m + l'th column of G^ with a 
linear combination of its first K — m + 1 columns, its rank will not change. If we choose the coefficients 
of such a linear combination to be the elements of ujj i2 (which are all nonzero almost surely), then since 
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by definition, {Q ji2 ) T u} ji2 = 0( K - m )xi, we get 



rank(G b] ) = rank(G 



Li] - 



(114) 



where 



q[j] A 





" (Qin) T 






. (Qii 2 f 






(115) 



and Qj^ and Qj i2 are respectively the submatrices of and Qj i2 including their first K — m rows. 
Hence, it suffices to show G^ is full rank. To do so, we note that Q ji2 is a [K — m) x (K — m) matrix 
with rank(Qjj 2 ) = rank(Q-, i2 ) = K — m. If we show that the matrix [Qj'i^j'h]^^ \ s 1S a ^ so a 
square full rank matrix of size (K — m + 1) x (K — m + 1), then using Lemma [2j it immediately follows 



>e(s K \s m )u{j} as - 



that G^l is full rank. Now, we rewrite [Q^o?^] ., 

j'e(s K \s m )u{i} = (C [n|lSm] ) T [D fil u> j/i2 } j/( - {SKXSm)IJ{j} . 
Since the matrices are square, we have 

det([Q^J ) = det(CN^l) • detdp^w^] ., 6(5 _ 



(116) 



\cS m )u{i}^' 



(117) 



and since C^ 1 ' 5 ™' is full rank almost surely, det (C^ Sm ^ ^ 0. Thus, it remains to show [D^a;^]^,^ , s 
is full rank. Using the same argument as in Appendix [A] one can write 



1 „[<a] 



(118) 



where a^ i2 is a nonzero scalar. Therefore, 



rank( la^D,-^ D n^l 



iran^fD^D^nN]^ 



■? 2 j j'£(s K \s m )u{j}' 



(b) 



(c) 



rank( 



hj'i 2 (t) 



l<t<K-m+l 
j'£{S K \S m )U{j} 



K -m+ 1, 



(119) 



where (a) follows from the fact that scaling the columns of a matrix by nonzero factors (aj/ i2 's) will not 
change its rank; (b) follows from the fact that scaling the rows of a matrix by nonzero factors (elements 
of n'* 2 ') will not change its rank; and (c) is true since ^ n 's are i.i.d. for 1 < t < K — m + 1 and 
f e (S K \S m ) u {j}. 

Lemma 2: Let A = |a,-,-l „ and B = [6,-,-l „ be two square matrices which are full rank almost 

L l Jimxm l- 'jJnxrt " 
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surely and let C = [c^] be an arbitrary matrix. Then the following matrix is full rank almost surely: 

C A 

D= . (120) 

B O. 

Proof: Denote by a,, b», and d, the j'th columns of A, B, and D, respectively. Assume that 



a jdj — 0( m+n ) x i, 

3=1 



(121) 



for some a%, «2, • • • , cn m+n G C. Then, since dy = for m + 1 < i < m + n and n+l<j<m + n, 
one can write 2^j=i a jkj = 0«xi and since B is full rank almost surely, we have a, = 0, 1 < j < n. 



This together with Eq. (121 ) yields YlT=n+i a j^j = 0( m +n)xi- Considering the first m elements of these 



columns, it follows that J^JLn+i a i a i-« = mx i and since A is full rank almost surely, we have <x, = 0, 
n + l<j<m + n. ■ 



Appendix C 



Closed Form Solution to the Recursive Equation (|6T|) for the 7^-user IC 
In this appendix, we derive a closed form solution to the recursive equation 

(K-i){2i + l) 



+ 



(K-i-l)i 



1< i < K - 2, 



K-i + 



Dof^(K) = 1. 



(122) 
(123) 



We start by rearranging Eq. (T22J) in the following form: 

1 i 



1- 



Dpfg .JK) (K-i)(2i + l) 



(K - i - 1) 1 - 



+ 



DoF^-i+iWy ' K-i + 1 



l<i< K-2. 
(124) 



Define A K -i{K) = 1 - Dopl c 1 ( ^ } . Then, we have 



= (tf-i)(2i + l) L 
A K (K) = 0. 

Express A K ^{K) as 



+ 1 



1< i < K - 2, 



[A'- 
a K- 



(125) 
(126) 

(127) 
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where a^_f is found using 



AK-i] 
l K-l 



[{K-i)A K ^{K)\ 



o<e<i. 



K= 



(128) 



Substituting the expansion of Eq. (127) for Ax-i+i{K) in Eq. (125), we get 



A K -i{K) 



(K-i)(2i + l) 



E 



(K- i -l)a [ tr ] 
K-i 



+ 



K-i 
K-i + l 



(129) 



Equations ( |128[ ) and ( |129[ ) lead to three recursive equations as follows: 

< I < % - 2, 



a 



[K-i] 



(I 



K-l 

[K-i] 
K-i+l 

[K-i] 
K-i 



(i-£ + l)i [K-i+i] 
(i-£)(2i + lf K - e ' 



2i + l 



2 [tf-H-i] , 1 

La K-i+\ + 1 



(130) 
(131) 



tE 



-1 [K-i+l] 



2i + i " z 



_ [A'-i+l] _ 



i-2 [Jf-i] 



2z + 



K- 



£=0 



+ 1' 



(132) 



where Eq. (132) follows from Eq. (130). Applying Eq. ( 130) z 



[K-i] 
l K-i 



- [K-e-i] ( ._ 



d n 



2j + l 



- 1 times, we will have 
< £ < i-2. 



(133) 



Substituting Eq. ( |133[ ) in Eq. ( |132[ ), we get 

i-2 



(7 



[K-i+l] 1 V— > [if-^-l] 



2i + i°*-< +1 2 



E 

£=0 



if- 



n 

j=£+2 



2j + l 



(134) 



(a) 



2z' + l 



i - 1 



2(z - 1) + 1) 



[K-i+2] 
L K-i+2 



i-3 



E41- 1 II 



£=0 



j=£+2 



2j + l 



1 i-2 

E 



[K-e-i] 

K—i 



n 

j=e+2 



2j + l 



z(z-l) 



\K-i+2] 



[K-i+l] 



(2z + 1) [2(z - 1) + 1] 



a K-i+2 o/o„- i i\ a -ft:-i+2 



2(2z' + l) 



(b) 



z(z - 1) 



z-1 



X 



(2z + 1) [2(2 - 1) + 1] ^ i+2 2(2z + 1) " 2(z - 1) + 1 

»(» ~ 1) 
2(2? + 1) [2(z - 1) + 1] 
z(z-l) 



2a [K - i+2] + 1 

za K-i+2 + x 



2(4z 2 - 1)' 



< i < K — 2, 



(135) 



where (a) results from reapplying Eq. (134) to a^_^\ and (b) follows from applying Eq. (131) to 

n K-i+l 
u K-i+2- 
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Employing Eq. (135) for a^/i in Eq. (131), one can obtain 



L K-i+l 



2i + l 

i 

2i + 1 



1 (»-!)(» -2) " 
4(i- 1) 2 -1 

" 3(t-i) 2 + (»-i)-i 

4(z- 1) 2 -1 



< i < K - 2. 



(136) 



It follows from substituting Eq. (136) in Eq. (133) that 

{ K-i] _ (t-e + i)(3£ 2 + e-i) yj j 



"K- 



2(4£ 2 - 1) 



A A .2j + l 



j=£+l 



0<£<i-2. 



(137) 



Finally, using Eqs. (|127[) and ( |135[ ) to ( |137| ), we have 

AK-i(K) : 



i-l 



2(4i 2 



v (.-£+l)(3£ 2 + £-l) n J n<,-<K- 9 mtt 

f 2. 2(^-£)(4£2-i) 11 2TTI' - z - ^" 2 - (138) 



1=0 



j=i+l 



Since, by definition, DoF ^^jK) = ±_ A ^ .^ K y we have the following closed form expression for DoF^_ i (K), 
< % < K -2: 



id -I) 



i-l 



(,_£ + l)( 3 £2 + £ _ 1) * j 
<).(K - Q\(m -\\ 11 27 + 1 



2(4i2-l)(K-i) ^ 2(JT-*)(4*»-l) .xx^j 



Appendix D 



(139) 



Closed Form Solution to the Recursive Equation (91 ) for the 2 x K X Channel 



In this appendix, we derive the closed form solution to the recursive equation 

(AT-i + l)(2i + l) 



(^-^+ i )(^+ i )+ d ^O^) 



Ki<K-l, 



DoF*(2,lO = l. 



(140) 
(141) 



Rearranging Eq. (140) in the form of 

1 z 

1 - 



DoF*_,(2,in (#-i + l)(2i + l) 



(K-i) 1 



DoF^ +1 (2, J fT) 



l<i<K-l, 
(142) 



and defining B K -i{K) = 1 — DoF x 1 ^k) ' one can wr ^ te 



B K -i(K) 



(K-i + l)(2i + 1) 



[(# - i)B K „ i+1 (K) + 1] , 1 < i < - 1, 



BifW = 0. 



(143) 
(144) 



Express B K -i{K) as 



where b^ f is found using 



B K ^K) = J2 



i-l h [K-i] 
°K-l 



1=0 



K 
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(145) 



>K- 



[{K-t)B K ^{K)\ 



<£<i- 1. 



Substituting the expansion of Eq. (145) for B K _ i+1 (K) in Eq. (143), we get 



B K -i{K) 



(K -i + l)(2i + l) 



i-2 

E 

.1=0 



(g - Q6g_7 +1] 
K-i 



+ 1 



Equations ([146]) and ( |147[ ) result in two recursive equations as follows: 

h [K-i] _ (i~ tji _ h [K-i+i] 



J K- 



'K- 



dK-i] 
>K-i+l 



(i-£-l)(2i + l) 

i-2 h [K-i+l] 



< £ < i - 2, 



2i + 1 



J K- 



1=0 
i-2 h [K-i] 



2i 



t-E 



e=o 



i — 



where Eq. (149) follows from Eq. (148). Applying Eq. (148) i 



j=e+2 



2j + l 



£ — 1 times, we will have 

< £ < i - 2. 



Substituting Eq. ( |150[ ) in Eq. ( |149| ), it follows that 



i-2 



, [K-i] _ » 

- 2z + 1 



-EC-/- 11 n 



£=0 



2j + l 



22 + 1 2i + 1 



i-3 

, _ \p , [K-t-1] TT 

°fi:-i+2 2—< K-t 11 



£=0 



j=£+2 



2j + l 



1 ulK-i+1] 



2i + l 2i + l K '- l+2 2i + 



i— 3 i—1 
^ . [K-i-1] TT 3 

K-i 



yE 6 £ n 



£=0 



2i + 1 2i + 1 



j=£+2 

.[tf-i+l] V^,[Jf-/-l] TT 3 
°K-i+2 "+* 2_^°K-£ 11 



2J + 1 



£=0 



j=£+2 



2j + l 



(a) « 



i-l 



2i + 1 2i + 1 2(i - 1) + 1 
4^1' O^^" 1 ' 



(146) 



(147) 



(148) 



(149) 



(150) 



(151) 



(152) 
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Usin g I2n=i w = ln2 ' 52n=i ^ = 2 ' and Yln=i 2^ = 1 ' il is easil y verified that, for any integer p > 0, 

P-i 1 

lim TJK) = lim AJK) = - In 2 + 2 1_p + > . (164) 



In specific, 



x->oo x-s-oo ^— ' n2 r 

n=l 



lim r 2 (lf) = lim A 2 (iT) = 1 - In 2, (165) 
lim T 3 {K) = lim A 3 (K) = - - In 2. (166) 

if— >oo K— >oo 8 



Now, using the following two lemmas together with the Squeeze Theorem, Eqs. ( |158[ ) and ( |159[ ) are 
immediate. 

Lemma 3: The following inequalities hold for A" > 3: 

IK" 3 K — ? 

^MK) < *(J0 < ^(tf) + < 167 > 

(i) Upper bound: 

, (J0 = y? (*-*-i>(«i+*-i> 'if ' 

0(K - 0, MAI/2 _ i\ 11 



2(A~-£ 1 )(4£?-1) 11 2£ 2 + l 

£i=0 v 1,1 1 ' e 2 =h+i 

A, 2 (K - ^)(«? - 1)(24 + 3) fe ll +a 2£ 2 + 1 
A' 1 £9 /\ 2 /v " 2 ' 



nt 2 XV — Z T-r 



6AT £f 2 2*2 + 1 5(iT-l) AJ-24 + 1 
^ 3 (^_£ 1 _l ) (3£2 + £i _ 1)(£i + 1) 



< 



' 1 , 2(K-^)(4^-l)(24 + 3) £2 i A +2 2£ 2 + l 

(a) jf-2 ff ^2 f 3(K-l) K yr 2 £ 2 3(AT - 2) ^ £ 2 

5 x 2 4 (AT- 1) 11 2£ 2 + 1 I 2 4 AT 11 2£ 2 + l 2 4 (A"-1) 11 2^ + 1 

*^ 3(K-£i-l) K yr 2 £ 2 
+ 2^ 2HK-£ 1 ) 11 2£ 2 + l 

K -2 ^ £ 2 ^ 3(^-^-1) Xyr 2 £ 2 

5 x 2 4 (AT- 1) 11 2£ 2 + l ^ 2 4 (K-£ 1 ) H 2£ 2 + 1 

^2=3 ^i=0 £2=^1+2 

(b) K — 2 3^+ 3 Kj-ii-1 
< 5(AT - 1)2 A ' + 2 ^ (AT- ^)2^i 
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where (a) follows from the fact that ^^r^^^ < § for £1 > 2 together with inequality | < ^, and 
(b) is valid since < \ for £ 2 > 2. 



(ii) Lower bound: 

^V^; o(K - PA(AP? - i\ 11 



K - 2 h 



fro WK-W-ti)M-l) Jli^- 1 
to 3K ^ 3 ^(X-^-l) 



2AT - 3 X (X - 4)2*-* 
3/^ 

' A 3 (K), (169) 



2K-3 

where (a) follows from the fact that (3 ^ + ^f 1+1) > \i x for t x > 0, and ^ > § for £ 2 > 2 
Lemma 4: The following inequalities hold for K > 2: 

^M*) < *(A0 < r,W + 2(Mf ( 5 1 )g_ 3) + & 

Proof: 
(i) Upper bound: 

t(J0 = y? (*-'.-i)('. + i) ff * 

1 ; ^ _ /> vw, ill 11 



(170) 



(X- ^) (24 + 1) 11 2£ 2 + l 

*i=0 v i;v i ' y ^2=^1+1 

(g - l) 2 ^ (K — £i — 1)(4 + 1) 2 (4 + 2) ^ l 2 

" 2(2K - 1){2K - 3) ^ (K - 4) (24 + 1)(24 + 3) (24 + 5) ^ ^ 2£ 2 + 1 

(a) (^-l) 2 2(^-1) ^ l 2 4 

2(2X-l)(2X-3) 15K £ \} 3 2£ 2 + l ^ 23(tf - 4) 24 + 1 

(g - l) 2 (K - 1) ^ l 2 ^ AT-^-i ^ 

" 2(2K - l)(2tf - 3) 15 x 23K 11 2£ 2 + 1 ^ 23(K - 4) J^ +3 2£ 2 + 1 

w (^-i) 2 | (^-i) | y *:-4-i 



2(2K - 1)(2K - 3) 15K2 K f-^ (K - 4)2*-* 

. (^-l) 2 K-l 

= r3W + 2(2^-l)(2K-3) + 15l^' (171) 

where (a) follows from the fact that ^ Irj^ii +3)1^ +5) < § f° r 4 > 1> an d O 5 ) is true since < \ 
for 4 > 3. 
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(ii) Lower bound: 



^ ' - PA 0.9, -H^l 11 



£l=0 V 17V 1 ' 7 &=<1 + 1 

y^ 2 (Ar-^-l)(^ 1 + l) 2 ^ £ 2 
^ o (2X-l)(X- W 4 + l)^ +2 2£ 2 -l 

(a) 2if l x [K-l x - 1) 

> 2AT - 1 ^ ^(^-£1)2^1 

2A A,(A'). (172) 



2X- 1 



where (a) follows from the fact that %±Jf > \l x for i x > 0, and > | for £ 2 > 2. 
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